Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Always use smallest offset for new partitionGroups #8053

Merged
merged 1 commit into from
Jan 24, 2022

Conversation

npawar
Copy link
Contributor

@npawar npawar commented Jan 21, 2022

As explained in issue #8052

Reverting the code from PR #7756 and using code from the alternative that was done earlier #7743

@KKcorps is working on enhancing the KinesisIntegrationTest

@codecov-commenter
Copy link

codecov-commenter commented Jan 21, 2022

Codecov Report

Merging #8053 (5a880a1) into master (16a0881) will increase coverage by 0.01%.
The diff coverage is 81.81%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #8053      +/-   ##
============================================
+ Coverage     71.41%   71.43%   +0.01%     
- Complexity     4261     4262       +1     
============================================
  Files          1599     1599              
  Lines         83075    83074       -1     
  Branches      12402    12401       -1     
============================================
+ Hits          59330    59341      +11     
+ Misses        19722    19715       -7     
+ Partials       4023     4018       -5     
Flag Coverage Δ
integration1 29.11% <81.81%> (+0.03%) ⬆️
integration2 27.73% <45.45%> (-0.13%) ⬇️
unittests1 68.15% <0.00%> (+<0.01%) ⬆️
unittests2 14.31% <54.54%> (+0.02%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...java/org/apache/pinot/spi/stream/StreamConfig.java 92.13% <0.00%> (-1.05%) ⬇️
.../core/realtime/PinotLLCRealtimeSegmentManager.java 78.36% <100.00%> (-0.45%) ⬇️
...a/manager/realtime/RealtimeSegmentDataManager.java 50.00% <0.00%> (-25.00%) ⬇️
...r/helix/SegmentOnlineOfflineStateModelFactory.java 58.49% <0.00%> (-4.72%) ⬇️
.../helix/core/minion/MinionInstancesCleanupTask.java 77.27% <0.00%> (-4.55%) ⬇️
...n/src/main/java/org/apache/pinot/common/Utils.java 60.46% <0.00%> (-2.33%) ⬇️
...ava/org/apache/pinot/core/plan/FilterPlanNode.java 86.86% <0.00%> (-2.03%) ⬇️
...core/startree/operator/StarTreeFilterOperator.java 86.01% <0.00%> (-1.40%) ⬇️
.../helix/core/realtime/SegmentCompletionManager.java 72.00% <0.00%> (-1.02%) ⬇️
.../pinot/core/data/manager/BaseTableDataManager.java 86.58% <0.00%> (-0.87%) ⬇️
... and 16 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 16a0881...5a880a1. Read the comment docs.

Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Let wait for @mcvsubbu to see if he has other comments

@npawar
Copy link
Contributor Author

npawar commented Jan 24, 2022

Need to merge this, already have two users in OSS waiting for this. If there's any concerns, will address separately in follow-ups

@npawar npawar merged commit 4e4b1ea into apache:master Jan 24, 2022
@npawar npawar deleted the live_table_bug branch January 24, 2022 16:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants